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I ...Introduction 

OW SHOULD one user of a network address messages 
to other users? The answer to this question is funda¬ 
mental in defining the appearance of the network to its 
For example, does one user have to know exactly where 
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the other is located, or just the region of the network, or is the 
address independent of location? Can he identify himself to 
the network or does the network know who he is automati¬ 
cally? If self-identification is possible, can he have several 
addresses corresponding to several roles or functions? Can he 
have multiple connections to the network, and can he move 
from one location to another without changing his address(es)? 
Can he send a single -message to a group or list of other users 
(e.g., a mailing list) automatically? Can he set up “conference 
calls” with other users, and join conferences in progress? Can 
he send a message to all other users? 

These questions are important for several reasons: some ad¬ 
dressing modes allow functions which would not be available 
otherwise (e.g., the ability to send a message to a distribution 
list without knowing the identity or location of the members 
of the list), and which are essential for certain types of users 
and applications. Furthermore, these addressing capabilities 
offer opportunities for efficient implementations that would 
not exist otherwise (e.g., a message addressed to a group can 
be transmitted with fewer packets than the equivalent sepa¬ 
rately addressed messages). The topic of addressing has re¬ 
ceived surprisingly little attention to date; the present paper 
indicates that it may be a fruitful area for further work. 
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The intent of this paper is to identify addressing modes 
which can be of value, both in providing a useful network 
interface for users and in permitting efficient network opera¬ 
tions within packet-switching networks (though several of our 
conclusions have broader applicability). We distinguish be¬ 
tween the addressing mode, how the user identifies the intended 
recipient(s) of a message, from the addressing implementation, 
how the network processes the message. The former is an 
interface between the user and the network; the latter is a 
protocol within the network. It is also useful to distinguish 
between addressing, how the network selects the destination (s) 
of the message, and routing, how the network selects the 
path(s) over which the message travels. 

We will use the term “node” to refer to the switching com¬ 
puter in the network (the DCE in CCITT terminology), and 
“subscriber” to refer to the host computer or terminal equip¬ 
ment connected to the network (the DTE). Connection of the 
subscriber to the node is over an “access line” (which may be a 
communications circuit) terminating at a “port” on the node. 
Thus a subscriber can be addressed by the node number and 
port number to which it is connected; we term this “physical 
addressing.” The address is specified as a part of the “header” 
attached by the source subscriber to its message. In the basic 
mode of operation of many computer networks today (see [ 1 ), 
for example), the subscriber presents a message to the network 
with an address corresponding to the destination subscriber’s 
physical location (see Fig. 1 (a)). While this approach is simple 
and effective, it is also restrictive, since it requires subscribers 
to know each other’s physical locations, and it does not en¬ 
compass such ideas as assigning a subscriber multiple network 
connections, or sending a message to more than one address 
or to one of several addresses, etc. 

Our investigations have led us to the conclusion that the fol¬ 
lowing three addressing methods would be valuable additions 
to most networks: 

1) Logical addressing, in which a permanently assigned logi¬ 
cal address denotes one or more physical addresses (see Fig. 
1 (b)). The sender does not need to know the physical location 
of the destination subscriber, and subscribers can relocate 
without change of address. Since one logical address can refer 
to several physical addresses, subscribers can connect to the 
network by multiple lines (“multiple homing”), increasing re¬ 
liability and traffic capacity (Fig. 1 (c)). 

2) Broadcast addressing, in which a message is addressed to 

all other nodes or subscribers (see Fig. 1(d)). If combined 
with an efficient implementation, this can reduce network 
traffic significantly compared with separately addressed 
messages. cm 

3) Group addressing- (Fig: 1(e)) and multidestination ad¬ 
dressing (Fig. 1(f)), in which a message carries the name of a 
list of addresses, or the list itself. When implemented with an 
appropriate delivery strategy, this also improves performance. 
It also facilitates electronic mail, conferencing, and similar 
applications. 

This paper describes the considerations involved in the design 
and implementation of the three methods described above. 
While there are many issues to be considered, we place the 
emphasis on efficiency and reliability, since these are the 
points that lead us to our design choices. The principle of 
economy of means suggests that an all-purpose addressing 
mechanism with a single implementation technique would 
be most desirable. However, we conclude that a different 
implementation is required in each case to provide the best 
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work) and to ensure adequate network reliability u 0 
mize loss of data due to errors or network fail.: 75 
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(e.g., TELENET) have adopted a hierarchies addressing v 
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advantages. Hierarchical addressing can be ^sed in comh- 
tion with any of the three techniques we disemss in this pap t . 

These addressing capabilities can be added : :> many kmdi /| 
computer networks; the present paper focus: m the t-xj--, 
of packet-switching networks. Virtual cb:.,: networks!*, 
which messages are handled as part of conr.iitions analo*.,.* 
to telephone conversations) can support very efficient 
addressing mechanisms because logical addressing informing 
needs to be sent only once per conversation. On the 0 i.-« 
hand, datagram networks (in which each message is lun.:>j 
independently, like letters in the mail) are less efficient 
logical addressing and yet can support brc-edcast ami gr> .? 
addressing more readily because it is unneiitsarv to set - 
complex set of pair-wise conversations. In it m.i\ iv 
unwieldy to install a general multidestm. r.:ou ;uli!re«--t| 
method for virtual circuit service, due to the extensive cure- 
required for each circuit, that few virtual c_-; jit networks * 
offer this service. Of course, addressing is :r.ly one oiTo-• 
points of comparison between virtual circuit and daUgn 
The debate on the relative merits of the twe methods has 
continuing for several years (see [ 2 ], for example). We k . 
that this paper contributes some new ideas t: that discussion 

II. Logical Addressing and Mult:. ; it Iui'.im 

A general logical addressing structure car. translate rM-y 
physical addresses into a single logical address and one pli>e.il 
address into many logical addresses. In a virtual circuit nct» 
the logical address is translated by the source node oiw :' 1 i 
connection, permitting all messages in a erven virtual u:- 
to flow to a particular physical address. In a datagram 
work, on the other hand, the addresses of messages are 
lated one by one and messages can flow t: any physica- 
dress. The source node may perform the trir.slation. or it ” 
leave the logical address untranslated in l:; message In • - 
latter case, each intermediate node performs the transD- ^ 
(without changing the logical address in me packet lica , 
before routing the message on the next Line; this may k’ 
in slightly better route selection. On the other hand, it -- 
not allow subscribers torefer to logical addresses as a part ■ 
group address (as explained in Section IV). In this papa 
will assume the source node performs the translation to r c -^; 
the delivery mechanism for group addressing proposed m- 
tion IV. 

Logical addressing also permits multiple homing 01 ^ 
scribers to network ports and the use of one network P°‘ 
the connection of several distinct subscribers. It is 
for the source subscriber to identify itself by means >■ ^ 
logical address in the message header, as well as stip ula 
destination logical address, if a completely general mapP 
desirable. etn||B 

Physical addressing represents one end of the sP e ^ 
message addressing. One difficulty with this approa ^ ^ 
changes in physical addresses must be announced 
scribers, with the inevitable operational problems sue 
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(Node 3 .Access Line 2) 
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Subscribers 0,E ond F Are MuMiply-Homed 
Possible Traffic Flow From A to D Indicated 
D Hos Multiple Physical Addresses,One Logical Address 

0,01,02,03, Have One Physical Address , Multiple Logical 
Addresses 




A Broadcasts a Messoge To All Nodes 



Subscriber A Sends To Group X = ( C , E, F ) 




Fig. l. Message addressing modes—terminology, (a) Physical addressing, (b) Logical addressing, (c) Multiple homing, (d) 
Broadcast addressing, (c) Group addressing, (f) Multidcstination addressing. 


Logical addressing for every subscriber is at the other 
l- °f the spectrum. In this case, the communications network 
^ the responsibility for keeping track of the location of 
su bscriber and translating the logical addresses used by 
^bers into physical addresses for internal data routing. 
J J lso possible to design hybrid approaches which intermix 
' lca I and logical addressing. 


A. Implementation Considerations 
Logical addressing of subscribers requires some form of 
“mapping table” for translation between logical and physical 
addresses. These tables must be stored at one or more loca¬ 
tions in the network and updated when changes occur. The 
cost of this maintenance depends on the size of the network 
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and the implementation of logical addressing selected. A 
number of possible implementations are considered below and 
their costs compared:' We select among several possible loca¬ 
tions for the mapping tables: partial tables at each node, com¬ 
plete tables at each node, a distributed data base of tables at 
the nodes, and a centralized table at one or several locations. 

1J Physical and Logical Addressing: This is a hybrid ap¬ 
proach which may be useful when a network designed for 
physical addressing only is modified to permit logical address¬ 
ing. There may be a transition period during which subscribers 
may use either method, and there may be a requirement to 
keep both methods if certain subscribers do not implement 
logical addressing. A subscriber uses either a physical or a 
logical address for each message which it transmits to its node, 
and identifies the type of address transmitted with an indica¬ 
tor in the message header. Logical-to-physical address mapping 
is performed at the source node for certain subscribers. The 
mapping table consists of TV-entries giving node number and 
port number, where N is the number of logically addressable 
subscribers in the entire network. When N is relatively small, 
the cost of the table in terms of storage required is insignificant. 

One shortcoming of this hybrid approach is that it does not 
solve the problem of physically addressed subscribers moving 
from one port to another. Since many subscribers have to 
change ports or nodes from time to time, there may be con¬ 
siderable operational difficulty in keeping all subscribers in¬ 
formed about physical addresses (a “telephone book” may 
have to be published regularly). The next two paragraphs 
suggest techniques for permitting all subscribers to use the 
logical addressing capability. 

a) Logical addressing- Complete mapping: The complete 
mapping approach to providing a logical addressing capability 
for subscribers extends the ideas above to include all subscrib¬ 
ers. The mapping table structure is the same, though its size 
is considerably larger since there is one entry for each of the 
subscribers. Even so, the table may not be impractical to store 
in primary memory for up to several thousand subscribers. 

bj Logical addressing —Partitioned mapping: A different 
structure for the address table can be developed by taking ad¬ 
vantage of the fact that, for routing purposes, a source node 
needs only the node information in the physical address, and 
the destination node needs only the port information. Rout¬ 
ing is naturally partitioned into two stages; the mapping process 
can be partitioned in a similar fashion. The mapping table at 
node X can be divided into two tables, the first with K entries 
containing node numbers, the second with M entries containing 
port numbers, where K isthfr.total number of logical addresses 
except those addresses,qf_sy bscribers connected to node X , 
and M is the total number of logical addresses of subscribers 
connected to node X. Multiply homed subscribers would be 
associated with one node at a time. The actual implementation 
of these two logical tables could be a single table with an entry 
for every logical address containing a data field and a Boolean 
variable to distinguish node entries from port entries. 

c) Logical addressing-information service: This approach 
is based on the existence of one or more information service 
centers on the network. The center(s) would maintain the 
address mapping information for the network subscribers and 
provide it to the nodes upon demand. Under IBM’s SNA, the 
System Services Control Point (SSCP) provides such a function. 
This approach is probably most useful for large networks in 
which there are a few large central nodes and many smaller 
nodes with reduced capabilities. Each smaller node might 
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maintain a set of address transformations used rccc 
together with those for its active connections and per , 
some others, to avoid access to the service centers f 0 . cv ' 
message. 

2) Relation to Multiple Homing: In many cases it is desira'-- 
to connect subscribers to more than one network node t 0 -T 
prove reliability (and also to provide additional bandw,'T 
over the multiple paths if they can be used simultaneousi-, 
Several connections to the same node can also be used v 
of the logical addressing techniques can be used to suppr.,. 
multiple homing, provided that multiple entries are present j 
the address translation table. There are three approaches -o 
routing messages over multiple access lines. The simplest 
proach is to use only one at a time. For datagram networti 
it is possible to route each message to the “best” access las* 
e.g., the one which minimizes delay. For virtual circuit nr-t 
works, an alternative approach-is to route entire virtual uj 
to one access line or the other, independently selecting :h* 
access line for each virtual circuit. For each approach it i 
useful to consider the issues of efficiency, reliability. j.-.; 
switchover management, routing (access line selection), i-: 
message processing (network error control, flow control, t-i 
sequencing); these topics are covered in the next n <_• 
subsections. 

B. Efficiency Considerations 

For a virtual circuit network, logical addressing can N- 
plemented by exchanging the appropriate mapping iniof-» 
tion between the source and destination nodes as pari ot :.v 
connection setup procedure. The result of this exchangr a 
that the source and destination nodes each remember 
physical address and logical address of the subscriber at :>■> 
other end. They can be used without reference to the .idC:m 
mapping table for the duration of the logical connexion. 
is an efficiency advantage not shared by datagram nei»or»» 
Specifically, in a virtual circuit net the packets flowing in 
network can be addressed with the physical address oi 'i* 
destination subscriber only, and the message header tor '- u 
destination subscriber can be constructed at the dcstin j"-; 
node. This message header must contain the logical addrru 
both source and destination subscribers. In a datagram 
the packet header must contain both the logical addreu 
formation for the subscribers and the physical address m.-<- 
mation for network routing. Since the main address iransla- ■* 
table is referenced only at call setup time in the virtual cm — 
case, it may be practical to store the logical-to-physical mi. 
ping table on secondary storage if available. Thus it 
that virtual circuits, once established, are more efticicnt 
logical addressing than datagrams. 

With respect to maintaining the address mapping tabic. • 
alternatives are central versus distributed and autc- 
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(adaptive) versus manual updating. A distributee 
approach, similar in concept to the ARPANEI rue- 
algorithm [1], is attractive. In this method, each n ° u 5< 
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used retMitk. t -ti onS Irom one line to another in case of a failure. Four 
ns and peiw! j^s must be distinguished. The dual-homed subscriber may 
■enters for I the source or destination. In each case, the failure that 


’ ■' essitates switchover may occur in the node or on the 

ses it is desmii. --ess in' 6 - These four cases are explained below, where we 
vorknodetchhl* ;'ine * l0W ^ ure ' s detected and what action is taken to re- 
tonal band»l*v ..jblish the existing logical connections via the alternate line, 
simultanem iT ' Case 1-Source Node Fails: The source subscriber can 
;o be used. A»* -;~t that switchover is required by observing the flow of 

used to su ’'.-ual or artificial traffic exchanged over its access line. It 
ies are prestntu ‘-v h aVe imperfect information concerning the disposition of 
ee approacha t» ‘ -- m essages ^ has sent int0 ttle networlc - The subscriber level 
The simplest ^ ., !0 col should have sufficient error-control capability so that 


ee approacha t» 
The simplest tp. 


tagram nct wu fa ^ lng or duplicate messages can be detected. 

best” access list ^ ' ^ ase 2-Source Access Line Fails: This case could be 


irtual circuit na' • -ated exactly like Case I: however, since state information 
ntire virtual calk ! " 111 interrupted logical connections is still available at the 
rtly selecting the ' uce nocie > a * 3etter P* 311 action is possible. A special con¬ 
ch approach it % ^ mechanism can be added to the network to permit the 


reliability, aM -'- rce 


node to forward all of its state information on logical 


re selection) cmnels associated with the source subscriber to another node 
flow control" u>{ •'hich the subscriber is connected. The subscriber could 
\ the next "fo* - n e° ntinue merely by retransmitting any message that was 
acknowledged when the access circuit failed. Even though 
j.cscriber level protocol must be prepared to deal with Case 
.1 may be more efficient to deal with Case 2 at the network 
ressing can'bs'to- ”*«l, making it invisible to the subscriber. 

mapping inform*' <, ■■■ Case 3-Destination Node Fails or Is Inaccessible: The 
ides as part of to -wee node will learn that the destination node is unavailable 
f this exchtajl tt i the network routing information. The source node can 
ch remember to jxcide to use the alternate address for the destination sub¬ 
subscriber it to j-'ber and route to other destination nodes. If copies of 

:nce to the addiw l*se messages are kept at the source node, either the source 
al connection;toi , or the source subscriber can initiate retransmission. The 
atagram network -rscriber protocol must then be prepared to handle duplicates, 
kets flowing into < Case 4-Destination Access Line Fails: The source sub- 
ical address of to ,-.oer can learn of the problem via a “Destination Down” 

ige header for to usage in response to one of its data messages. The source 

at the destitute ; mie can decide to use the backup destination access line; 
e logical addrMlrf i xnection resynchronization is similar to Case 3 except that 
In a datagram te *inional state information about each logical channel is 
logical additm ► I-relable at the destination node. This information may be 
'sical addres fate to the source node (or possibly to the new destination 
i address truuMto* ^1 1 , but that would be more complex) in order to return to 
in the virtualdrte * source subscriber all acknowledgments queued at the 
;al-to-physical toT 5 »vjnation node. Message duplication is still a possibility and 
le. Thus it »PP**' c tr the source node itself or the source subscriber might 
more effidert 1 ‘ j ally effect the retransmission. 
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datagram Considerations 

iauting each meSSagS.'ifldependently to one access line or 
* other satisfies -the reliability objective and is attractive in 
of the goal of providing flexible allocation of access line 
‘t-width. However, there are costs associated with the more 
'Plex routing and message processing required. 

' touting: Each message is independently routed to one 
access lines connecting the destination subscriber to the 
*"'°rk. The source subscriber or the source node can direct 
^ Message to its destination; ho .--•ever, in neither case does 
i lQ urce entity have information about the present or future 
,J IC over the access lines to the destination subscriber. To 
^■fiate these problems the network routing algorithm may 
Signed to incorporate routing information concerning 
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multiply homed subscribers so that each node knows its best 
route to each multiply homed subscriber. In other words, if a 
subscriber has more than one access line, and if any message 
can flow over any access line, then the access line selection can 
be treated as a routing problem rather than an addressing 
problem. The routing process must deal with choosing routes 
to nodes with more than one line, so it can be augmented to 
deal with multiply homed subscribers as well. 

2j Message Processing: By message processing we mean 
error control, flow control, and sequencing. Dynamically 
assigning datagrams to access lines requires dual-homed sub¬ 
scribers to do message processing themselves. Any attempt 
to use multiple logical channels for a single logical data stream 
requires the destination subscriber to be involved in reordering 
and related functions. An error control mechanism is required 
to handle both missing and duplicate messages. Reordering at 
the destination subscriber is required if either the destination 
subscriber or the source subscriber is multiply homed; sequence 
numbers can be attached to messages by the source subscriber 
to allow the messages to be identified and reordered by the 
destination subscriber. 

3j Switchover Management: Detection of a failure and 
switchover are as described in Section Il-C. Since an alternate 
logical connection from the source to the destination already 
exists, the source subscriber needs to retransmit only those 
messages whose disposition is unknown at the time of the 
failure. 

E. Virtual Circuit Considerations 
Associating all of the messages of a virtual circuit or-“con¬ 
versation” with a single access circuit is a compromise which 
not only provides high reliability and makes relatively efficient 
use of the existing access circuit bandwidth, but also is well 
suited to the logical addressing schemes described in Section 
II-A. 

1 j Routing: If a multiply homed subscriber is connected to 
different nodes, the source node establishes a logical channel 
for the entire conversation to a destination node selected from 
among alternatives in its logical-to-physical address mapping 
table, based on current routing data. If a subscriber is multiply 
homed to a single node, only a single entry exists in the map¬ 
ping table at the source, and access circuit selection occurs at 
the destination node. The destination node records multiple 
port numbers for each of its multiply homed subscribers in its 
address mapping table and selects one when the “call request” 
message associated with the conversation is received. The' 
structure of the address mapping table must permit multiple 
nodes and ports for a given address in order to implement this 
scheme. 

2) Message Processing and Switchover: As in Section II-C, 
no message processing functions are required of the subscribers. 
The method of detecting that logical channels need to be 
switched from one access line to another and the procedure 
for effecting the resynchronization are also identical to the 
methods and procedures described above. 

III. Broadcast Addressing 
Broadcast addressing means the capability for one node to 
send a message to all other nodes by marking it with the ad¬ 
dress “ALL” rather than by sending separate messages to each 
node. This topic has not yet received much attention. Dalai’s 
1977 dissertation, “Broadcast protocols in packet-switched 
computer networks” [3], discusses the design and analysis of 
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broadcast routing algorithms for use in packet-switched com¬ 
puter networks. Five alternatives are considered in terms of 
qualitative implementation and quantitative performance. 
Many internal network algorithms as well as subscriber ap¬ 
plications require an identical data base at all nodes. For 
instance, the logical addressing algorithms discussed above 
assumed an identical address translation table at each node. 
Also, as explained below, some adaptive routing algorithms 
depend on having up-to-date information on all network 
topology and traffic. Broadcast addressing can be used for 
the propagation of information throughout the network 
to all nodes. For this reason, we will sometimes refer to the 
broadcast messages as “updates” in the discussion below. 

To provide additional background for this topic, it is useful 
to consider the changes proposed for the ARPANET routing 
algorithm. The current ARPANET routing algorithm [1] 
determines which nodes are reachable from a given node (by 
exchanging routing update messages with other nodes) within 
several seconds of a change. We would like to shorten this 
time, since we have observed, on occasion, that congestion can 
build even in these few seconds [4]. The basic reason for the 
delay in adaptation rests with using a routing algorithm which 
has information on entire paths only, not individual lines, and 
which relies on hop counts and timers to determine whether 
nodes are reachable. Since this is an essential feature of any 
ARPANET-like algorithm, we were led to consider other types 
of procedures to increase the speed of adaptation, while re¬ 
ducing the cost. 

It is practical to implement a separate and independent 
shortest path calculation in each of the IMP’s in the ARPANET 
as opposed to the present distributed computation [5], Such 
an algorithm can be designed to be very efficient in space and 
time, using as little as 1 or 2 ms of CPU time, on the average, 
to perform an individual update when the calculation is per¬ 
formed incrementally. Efficient and reliable updating proce¬ 
dures can be developed so that a shortest path algorithm can 
be performed on an event-driven basis. 

The shortest path algorithm has significant advantages over 
the present ARPANET algorithm in terms of efficiency, re¬ 
liability, loop freedom, and speed of adaptation. The basic 
algorithm can be attributed to Dijkstra [6]; because of its 
search rule, we call it the shortest path first (SPF) algorithm. 
The algorithm used to generate the shortest path tree initially 
is illustrated in Fig. 2. (We have also developed an algorithm 
for modifying the tree incrementally when network changes 
occur.) 

The basic algorithm for finding the shortest path tree from 
a given source node is a-way. of building up the tree node by 
node. That is, the-tree-rnftially consists of just the source 
node. Then the tree is augmented to contain the node that is 
closest to the source and that is adjacent to a node already on 
the tree. The process continues by repetition of this last step. 
The tree is built up SPF—hence the name of the algorithm. 
Eventually, the furthest node from the source is added to the 
tree, and the algorithm terminates. As a by-product of the 
algorithm, it is simple to produce a routing directory. In the 
ARPANET, each node will run the algorithm with itself as the 
source. In order to run the algorithm, each node must main¬ 
tain a data base representing the topology of the network. A 
key component in the data base is the “length” of every line 
in the network (where “length” is not physical length, but 
rather some relevant metric such as delay). This data base can 
be updated using broadcast addressing to distribute informa- 


Mark All Nodes Not “On List" 


Put Root (Self) "On List" 



Fig. 2. Shortest path first routing algorithm (Sl’l ). 
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Sequence Of Message Flow Indicated by Numbers 
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(b) 

Fig. 3. Broadcasting and flooding, (a) Broadcasting, (b) FIuuxl* n| 


tion from the node which discovers a change on one of its l - 
(e.g., in delay or error rate) to all other network nodes. 

A. Implementation Considerations 
There are two general types of approaches to the problem ^ 
transmitting a message to all possible addresses: to roui^ 
once to each node (termed “broadcasting” here), or to 
copy over each network line (termed “flooding”), h ._ 
may be simpler to implement, but the nodes receive nui 
copies of the message. . ^ 

Broadcasting is a system in which the source expbci 
dresses the message to all nodes, by labeling one or more >• 
with the appropriate addresses for each of its output 
routing them to each node along the best path (see F'?- ^ ^ 
Such a scheme can require as little as N -1 packet hops ^ 
broadcast, which is optimal (N is the number ot nodes 
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^pvork). Each broadcast address is represented as an N-bit 
■ A)0 r, each bit indicating whether the message should be sent 
, the corresponding node. The N bits are needed to indicate 
’ ‘ juch nodes have received the message so far and which nodes 

.jve not; bits are turned off as the message flows through the 
^tv/ork. The source of the message sets the address of the 
, ;SS age transmitted on each of its lines to have bits corre- 
, jn ding to those nodes for which that line is the best route, 
■jier nodes receiving such messages turn off their bit and then 
.fforin the following operation on the resulting address: for 
■li adjacent node, take the logical AND of the received ad- 
, jS and the bit vector of nodes for which the adjacent node 
• he best route. If nonzero, send a message with the resulting 
m (SPF). ,\D’ed address to that adjacent node. Broadcasting is the 

v neral method for sending a message to multiple destinations, 
j will be referred to again in Section IV. However, in the 
] .dal case of addressing all nodes, the next method may be 

■.•ferable. 

Flooding is a method in which each node sends each “new” 
:Jate on all its lines except the line on which the update was 
I—| .jived (see Fig. 3(b)). A new update is one the node has not 

1 E I n before; the serial number is larger than the last one re- 

,ed for that particular node. This requires L - N + \ packet 
:i (where L is the number of lines in the net, counting each 
■.ction separately), since an update will flow on all lines ex- 
-I “backwards” on the N - 1 lines of the broadcast tree from 
. • :: source. If we define L = cN, where c is the average node 

. -.nectivity, then this number of updates is cN - (TV- 1) = 

- 1 );V + 1. 

»e assume that the technique for addressing all nodes must 
3,e 41 ,-t the following criteria: 
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Normal 

Operations 

low CPU and 
line overhead 
sequencing of 
multiple 
updates 


Node Failure 
or Partition 

fast notification 
at low overhead 
no loss of 
updates 


Node Recovery 
or Partition End 


complete 
information 
made available 


■orally, it is difficult to meet all of these objectives; effi- 
"cy and reliability are discussed in turn below. 


fficiency Considerations 
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NUMBER OF NODES 

Fig. 4. Overhead per line (assuming 1 update/node/1 00 s). 

point occurs when 

(b + N) (N - 1) = 6 ((c - 1 )N + 1). 

This is illustrated in Fig. 4 below for b = 200 bits, t = 100 s. 
For c = 2.5, crossover comes near (200) X (0.5) = 100 nodes. 
For c = 4, crossover is not until 400 nodes. Note, however, 
that for c = 2.5 both methods require less than 100 bits/s 
(0.2 percent of 50 kbits) to update 80 nodes at a rate of once 
every 100 s. The line overhead scales linearly with t, the up¬ 
date rate, so other strategies can be compared simply by re¬ 
labelling the 7 axis. (For instance, if t = 10 s, then updating in 
the ARPANET with N = 62, c = 2.5 would require 750 bits/s 
which is only 1.5 percent of 50 kbits). 

Some interesting points emerge from examination of Fig. 4: 

1) The overhead for flooding can be plotted as a straight 
line on log-log paper, with practically no dependence on c. 
This makes it useful for long-range planning, since it is not sen¬ 
sitive to network topology. 

2) For a given number of nodes, flooding grows less efficient 
as the net is more highly connected, while broadcasting grows 
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important consideration in efficiency is line bandwidth; 
’- bandwidth requirements can be shown to be very small; 

Broadcasting: The message is b + N bits long, where b is 
: "umber of bits in the body and N is the /V-bit address. 
• s the total number of bits on all lines is (b +N)(N - I). 
ueforc, the total bifrate.per line if each node updates every 
t; °nds is jra- 

" (6;+-(V)(JV- 1) 


Flooding: The message length is only b bits, so that the 
number of bits on all lines is b({c- \)N + 1). The total 
ite per line is 


6((c- 1 )N+ 1) 


■''^casting is quadratic in N, which means for large enough 
' become more expensive than flooding. The crossover 


more efficient. 

3) The two methods are quite similar for.networks with 50 
to 200 nodes. 

4) The magnitude of the updating overhead is very low, 
even for large nets. 

Since flooding is more efficient for large nets, and is very 
efficient in absolute terms for small nets, it is the best overall 
choice for efficiency.' 

A second important advantage of flooding is that the node 
sends the same message on all its lines, as opposed to creating 
separate messages with different bit-vector addresses on the 
different lines. This may make it considerably simpler to 
program the broadcast addressing mechanism, since there is 
no problem of reserving buffers or dealing with the situation 
in which the node has no more buffers for copies of messages. 
A final consideration which favors flooding is that it does not 
depend on the correct operation of the routing algorithm, and 
is therefore less sensitive to network failures. This makes it a 
safer, more reliable system than broadcasting. 
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C. Reliability Considerations 

At first glance, it seems essential to acknowledge (ACK) mes¬ 
sages to make sure they get through. This is useful for flooding; 
if messages are acknowledged at each hop, then with flooding 
the message will be received at all nodes which have a path to 
the source at the time of the transmission. On the other hand, 
with broadcasting using an n-bit vector, transmission is not 
reliable. Two examples are 1) a node which receives an up¬ 
date, acks it, and then fails, and 2) a section of the network 
which is partitioned from the rest while an update is flowing 
through it destined for the main body of the net. In each 
case, an update will be lost. Under broadcasting, acknowledg¬ 
ing updates at each hop is not sufficient to ensure reliable 
updating of all nodes which have a path to the source at the 
time of the update. If a positive acknowledge/retransmission 
system is used, then appropriate data and control structures 
are needed in the node. Some possibilities are: 


Method 

Problems 

Separate ACK’s 
invent a new set of 
logical channels for 
routing, common to all lines. 

Periodic ACK’s 

Send all ACK’s 
periodically rather than 
one at a time in separate 
messages. 

adds complexity to the node 
(packets on multiple queues, 
etc.) 

slower reaction to a 
tost update than usual 

ACK system. 

One last possibility, though not an ack system, is: 

Periodic rebroadcast 

Send the update once only, 
and rely on a periodic 
retransmission to ensure it 
gets through. 

even slower error recovery, 
though very reliable in 
the long run. 


If separate ACK’s are used, the ACK could look very similar 
to the packet acknowledgments. The expected number of 
updates per second would be very small, since there are very 
few updates/line/second with either broadcasting or flooding. 
(For instance, if updates were generated once a minute on the 
average by each ARPANET node, then an update message 
would flow over each line every 2 s on the average.) 

For periodic ACK’s, one could use the periodic test messages 
exchanged between nodes (termed “Hellos” here) to carry a 
1-bit ACK for each node. This would require an additional N 
bits per Hello message, rather than a separate ack message for 
each update. A drawback of this scheme is that the sender is 
“blocked” from sendingrj^other update about some node 
until the previous onals ACKed. 

We now compare these two possibilities in terms of the extra 
line overhead they require. In both cases, we will assume a 
136-bit Hello message (the same length as a separate ack mes¬ 
sage) is sent every 640 ms, contributing 212 bits/s of overhead, 
and we are concerned only with additional overhead beyond 
this. The amount of line overhead used by the two ack meth¬ 
ods is shown in Fig. 5, for both broadcasting and flooding in 
the case of separate acks, for t = 10 s, and t - 100 s. The fol- 
lowingstatements are true for all values of N (all network sizes): 

Separate ACK’s with flooding use 50 percent more bandwidth 
than separate ACK’s with broadcasting. 

All ACK’s in the Hello are better than separate ACK’s if t, 
the routing update period, is small. 

Any ACK method will contribute a significant percentage to 
line overhead, as much as doubling the routing overhead, but 
this is probably a small factor in absolute terms. 
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The total overhead associated with routing is the sum -a 
routing update, acknowledgment, and Hello overheads i < 
the cases under consideration, we have 

Broadcasting: 



% 

1CK, and p is 
typical land lim 
ach). Thus 

■b 

:■ j + r 5 
**" P 64( 


Separate ACK 


(336 + N)(N - 1) 


ACK in Hello 


Flooding: 


Separate ACK 


ACK in Hello 



Ct 

(200 + 

IV) (N- 1) 


Ct 

336((c 

- 1 )N + 1) 


Ct 
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- \)N + 1) 


136 

64 
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64 


ct 



These four cases are compared in Fig. 6 for r = 10U -. ■ 

It is obvious that the line overhead is dominated b> ihe b 
messages for networks with less than 100 nodes. In bus 
it is possible to choose among the updating alternative' : 
sen ted here on grounds other than line overhead. 

As an additional precaution, especially during test in¬ 
stallation, it is possible to reflood the net periodically "d 
update information from each source. For instant, 
periodic rate could be set at 1/100 s, which would add on.' 
bits/s to each network line. 

With any ACK method, there are other difficulties to ^ 
solved. With a separate ACK scheme, the sender must v 0 -' 
timer for each un-ACKed update, and resend it period 1 -* 
With the ACK’s carried in Hello messages, there is the * 
that the receiver will have just sent a Hello containing 
serial number bit when it receives the new update, caU ^ n *, 
sender to retransmit the update unnecessarily. The pro 
of the update and an “old” ACK crossing in mid-fligh' ls 

r + r 
P 

where j is the time to send update, r is the time to send 
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r Une - .'K, and p is the period for sending Hellos (0.64 s). For 

pical land lines r and r will be equal and small (about 25 ms 
; is the sura of thr ..h). Thus 
> overhead*; F« 

s + r 5 ms 

** "77” = 777 = 8 percent spurious retransmissions. 

, r 64 U ms 
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Subscriber A Sends o Message to C,E and F 


4 Packet Hops Required (Instead of 6 Packet 
Separately Addressed Messoges) 


Hops For 



and multiply homed subscribers). Such a group may corre¬ 
spond to an on-going conference call or distributed working 
group of some kind, or it may be a simple distribution list for 
certain messages. In addition to such pre-established group 
addresses, it may also be useful to provide a general capability 
for addressing messages to a list of subscribers. This multi¬ 
destination addressing can cut down on network traffic and 
subscriber overhead by substituting a single transmission for 
several separately addressed messages (see Fig. 7). 

A. Implementation Considerations 
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136 +N 
64 
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64 

r t = 100 s,e-:i 
inated by the IWv 


Uternatively, the node could keep a clock for each destina- 
n which would ignore any Hello/ACK’s within the last * 
■Jiseconds. This would be necessary on satellite lines, where 
probability of retransmission without the timer becomes 
«to 1. There the timer must be longer, e.g., 600 ms. 

*hen a node comes up, or when it returns from a partitioned 
(in which it was isolated from several other network nodes 
• pically when its line(s) to the network were down) it must 
j complete update of all information contained in broadcast 
htes, since an indeterminate number of updates have taken 
■:t. Two possibilities exist: 

i The two adjacent nodes which were isolated from each 
-rsend each other their entire update tables. 

•) The two adjacent nodes exchange table entries for all 
'chable nodes. 


es. InthiinV ;l > e first is somewhat simpler to program, but uses more 
alternative* P* ^ bandwidth than the second. If the table is garbage- 
id. ,. cectcd or compacted to remove entries for unreachable 
ring test anil*' "- es > then the two methods are identical. If compaction 
odically with0* ' :ot to ° difficult, it is probably the best method, 
nr instance, [ ben a node receives such an update, possibly containing 
3 uld add on& j^twn on many-nodes previously unreachable, it treats 
i ‘ <e a n °rmal singfcgo&tupdate, and sends it to its neighbor 
ficulties tobeff^ by the Hooding method. This works well for both sides 
ader mustWf'i' 11 a node that was dbwn comes up; it gets all the tables 
d it periodic*®! its neighbor, and the rest of the net gets its own single 
ere is thecW®*!/.* en by. (Several messages may be required to send all the 
on tabling I®* ile information to a node or nodes which were previously 

,date,ca u sWj^>ed.) 

Thep« b * l * W 

ud-ihshtk lv - Group Addressing and Multi destination 

Addressing 

.^reasons of convenience and efficiency, it is desirable to 
dSelrtbj 1 6 3 Anility for addressing messages with the name of a 
time to sen . , P of addresses (logical and physical addresses, singly homed 


In a virtual circuit net, group addressing and multidestination 
addressing are unwieldy: both inefficient and difficult to con¬ 
trol. The two basic alternatives are to set up (a) X (a) virtual 
circuits when a addresses are present in the group, or to modify 
the packet header to permit multiple message numbers, 
acknowledgments, and allocations to How over the same multi¬ 
destination virtual circuit. Both methods appear to be so com¬ 
plex that it is difficult to justify their implementation. For a 
datagram with many addresses the problem is simply to route 
the datagram efficiently to the destinations. 

The issues of formatting packets and messages with logical 
addresses and multidestination addresses deserve some con¬ 
sideration. Group addressing is simpler to implement in the 
network since it requires a relatively small change to the sub¬ 
scriber software—the group address replaces the usual physical 
or logical address. On the other hand, multidestination ad¬ 
dressing is more flexible and.useful t.o the subscribers but 
requires a fairly major change in the subscriber-to-network 
format, since a new variable-length address format is needed. 
Careful attention must also be given to the interaction between 
logical addressing and group addressing, since group addressing, 
in general, should permit reference to logical as well as physical 
addresses. As an example of this interaction, if a group address 
refers to several logical addresses as well as physical addresses, 
then the translation of logical-to-physical addresses must take 
place at the source node. 

B. Efficiency Considerations 

The efficiency of a multidestination or group addressing 
system depends critically on the routing algorithm used. One 
useful metric for determining the efficiency of a multidestina¬ 
tion system is the number of packet hops required to transmit 
a given packet to all the destinations (the number of hops 
traversed by each packet summed over all packets transmitted). 
A simple routing algorithm can be designed for multidestination 
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Fig. 8. Multiaddress packets: Number of packet hops. 
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Fig. 9. Multiaddress packets: Percentage improvement. 
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transmission which is similar to the “broadcasting” technique 
described in Section III-A. It can be constructed on the basis 
of a standard routing algorithm for single destination packets 
(e.g., based on minimum path length or minimum delay). In 
addition to this algorithm, it is necessary to provide a multi¬ 
destination address (an A-bit vector indicating the destination 
nodes) in the header of the packet. When the packet arrives at 
an intermediate node, the node simply creates as many copies 
of the packet as there are different routes in the routing direc¬ 
tory for the different destinations in the header. Each time 
multiple copies of a packet are created at a node, each copy is 
assigned the appropriate subset of the destinations for which 
that line is the first line on the best path. In this way a broad¬ 
cast of a given packet to all 7V-1 other nodes in the network 
can be accomplished with only N -1 packet hops, which is 
optimal. (Note that this routing algorithm is not optimal for a 
message addressed to fewer than N-l other nodes; some form 
of minimum spanning tree algorithm is needed to achieve the 
minimal number of packet hops in the general case). 

It is revealing to analyze the performance improvement, 
measured in packet hops, gained by multiaddress messages using 
the simple routing procedure based on minimum path length 
described above. The following definitions will be useful: 

N number of nodes in net, 
a number of addresses*...; 
p(a) number of packJOtcspS^ 

A average path length, ' 
c average node connectivity. 

For separately addressed packets, an average of A X a packet 
hops are required to transmit a packets. For multiaddress, p(a) 
is a more complicated function. Clearly, p(l) = h and 
p(N- l)-N- 1. A little thought shows that p(a) <A X a for 
all a, and p(a)>a for all a. Furthermore, p(a + A) < p(a)+ 
p(A); p(a) is concave downward. 

Figs. 8 and 9 show some empirical investigations we made to 
determine the behavior of p(a) for the ARPANET. Although 
we have not found a closed-form expression for p(a), a close 
fit for p(a), based on data from the ARPANET and other net¬ 
works, is: 

p(a) = Aa - (A - l)a X Iogjv-i( fl )- 


That is, the percentage improvement of multiaddress i«: 
separate addresses is given (approximately) by 

(A - 1 )a X logjv_ i (a). 

Thus in the ARPANET (A = 62, c = 2.5, A = 5.5), the grcaim 
savings in number of packet hops, 80 percent, occurs wl:.- 
addressing all other nodes in the network. When addrew.-i 
eight destinations (equal to the square root of the number . I 
nodes in the network), half of this relative improvement. >-< 
about 40 percent, is obtained. We have calculated that a.: 
dressing as few as 5 to 10 destinations in the same I’adst. 
results in a savings of 25 to 50 percent of the packet hop' 
quired in the ARPANET with separately addressed packets 



C. Reliability Considerations 

Since we have assumed that group addressing and multn-r* 
tination addressing are not practical for virtual circuit seo.-- 
and should be implemented only for datagrams, the subsui." "■ 
using these services must take responsibility for providing* 
liable transmission for the end users. A host-lew! proiix-c* * 
necessary between the sending subscriber and eacli reeci'c 
ensure an error-free, sequenced flow of messages between r 
pair of subscribers. 

V. Conclusions 

The enhanced message addressing modes discussed m ^ 
paper have several important advantages over physical 
ing. Logical addressing provides for considerable opera 1 ^ 
flexibility and reliability. The use of multidcstinatw ^ 
group addressing has been shown to lead to signifn- 311 ^ 
tion in network traffic, even for the case of relative s ^ 
tinations per message. One of the important conclusion^ ^ 
this work is that while virtual circuit networks have s ° 
ciency advantages over datagram networks for logic 3 
ing, datagram networks facilitate the use of broadcas 
ing and multidestination addressing. These importan^^ 
of comparison have not yet been fully considered 
work design community. , e 

While this paper has focused almost exclusively °n ^ ^ rc3 u3»J 
pie of terrestrial packet switching networks, many ° 
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I ;3Si be extended to other kinds of networks. Of particular 
merest is the use of broadcast and group addressing in net- 
.orks which contain broadcast/multiple-access links, such as 
i yielhte and radio channels. 
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distract Packet switching technology emerged rapidly in the 1970’s 
! ‘‘ J, ° ther vlable mode of communications switching, along with circuit 

^ 7 ::;!: switchin8 - since packet 

ca P abilities a multiuser environment, it 
I ^klerviats ^ f ° r funUshin S P ubUc data communication net- 

networks are now esUblished or being developed in 

a rahed ‘olf and dle introduction of these networks 

oonai np ^ 'X 1SSUe f r . datmg to thc ‘ structure and regulation of the 

"aiemational^’ w ‘ nteloonnecti ° n °f national networks into 
uernational packet swttchmg system. 

^cL P e aP "J e T WS the5e isSUes and concludes that public packet 
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<*, TOtmtrie” th^ 9i? S.r- C ' ket network wil1 “tst in each of most 
’ a ‘ i PankeiTnetworks will aggravate the problem of 

rfl "> 8 unicatf n °ntegufatedTIata processing services from regulated data 
**et netwo t S ? mC ! S '’ tha M“t«national interconnection of public 
k next's P v° r ^ S baSCd UP ° n CCITT standards will occur rapidly over 
»s< m will and that . a , unified international packet switching 
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I. Introduction 

D URING the mid-1970’s public packet switching net¬ 
works emerged in a number of countries, offering com- 
puter users and communicators a highly cost-effective 
and versatile means of transferring digital data between termi¬ 
nals and computers. The introduction of these new services 
as raised several national and international policy issues the 
resolution of which will affect computer users, computer 
equipment manufacturers, communication common carriers 
ana the general communicating public. 

This paper is intended to introduce the reader to these policy 
issues, to review the principal arguments expressed on each 
issue, and to indicate the likely policy resolution in the future. 

e paper is organized into two major sections, the first cover¬ 
ing the structure and regulation of packet switching services at 
the national level, and the second section covering the struc¬ 
ture, pnemg, and standards-making activities relating to packet 
networks at the international level. 

A typical packet switching network consists of many distrib¬ 
uted store-and-forward switching centers, multiply intercon¬ 
nected. Such a network is rimilar to many private data com¬ 
munication networks in that it may be implemented by leasing 
the communication channels from the traditional communica- 
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